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Abstract 

The game-theoretical approach to non-extensive entropy measures of statistical physics is based 
on an abstract measure of complexity from which the entropy measure is derived in a natural way. A 
wide class of possible complexity measures is considered and a property of factorization investigated. 
The property reflects a separation between the system being observed and the observer. Apparently, 
the property is also related to escorting. It is shown that only those complexity measures which 
are connected with Tsallis entropy have the factorization property. 



I. ENTROPY VIA COMPLEXITY 



The present contribution should be seen in the context of the overall goal: to give op- 
erational definitions of entropy and related quantities which cover the classical as well as 
non-extensive settings, thereby leading to an understanding of which of these quantities, in 
particular which entropy measures, are relevant for statistical physics. 

The findings here reported constitute a companion to the game theoretical approach 
discussed in Tops0e |3:]. For the convenience of the reader, we repeat some of the essentials. 
The key objects of the approach are the alphabet A, taken to be discrete, the strategy set Sj 
of Player I ("Nature"), also referred to as the preparation, a strategy set Sjj for Player II 
( "the physicist" ) and a real, or extended real valued complexity function $ defined on the 
product set Sj x Su: {P,Q) r\ ^{P\\Q). The strategy set Su is here taken to be the set 
of all probability distributions over A and Sj is assumed to be a subset of Sjj. A typical 
element in Si is denoted P and a typical element in 5*// is denoted Q. Point probabilities 
are denoted by a subscript i which then ranges over A, e.g. P = (pj)jg^, Q = (gj)jg^. 

The basic axiom we shall work with concerns the complexity function and states that for 
each P & Sj, the minimum over Q G Sjj of $(P||Q) is finite and achieved for Q = P and 
for no other probability distribution. 

The entropy function S^ is defined by 

5^(P)= inf HP\\Q). (1) 
The essential requirement imposed on the complexity function is then that the bi-implication 

^P\\Q) = S^iP) ^ Q = P (2) 
holds for any P E Sj. Divergence D{P\\Q) is the difference between complexity and entropy: 

D^{P\\Q) = $(P||Q) - S^{P) = ^P\\Q) - ^P\\P) . (3) 

The game alluded to in the title is the two-person zero-sum game for which Player I aims 
at high complexity and Player II at low complexity. As is evident from (P), a maximum 
entropy distribution is the same as a maximin strategy, i.e. as an optimal strategy for 
Player I. We are thus led directly to Jaynes maximum entropy principle (MaxEut) and the 
game theoretical approach can to some extent be said to explain that principle. A deeper 



understanding requires that also optimal strategies for Player II are taken into consideration. 
For details, see jsf. 

We claim that the game theoretical view offers sound principles which appear more nat- 
ural and at a deeper level than MaxEnt itself. It has to be pointed out, however, that the 
approach does not give a clue to which entropy measures appear naturally in physics. Some 
results which address this problem from the game theoretical point of view are contained 
in and here we continue research in this direction. We focus on the triple ($, S*, D) of 
complexity, entropy and divergence and limit the study to triples of the form 

S{P) = -Y.f{Pi). (5) 



ieA 



D{P\\Q) = '£<1-Ji^)^ (6) 

Hi 



<iij I 

ieA 

where /, the generator, is a real- valued analytic and strictly convex function on [0, oo[ such 
that /(O) = /(I) = and such that the normalization condition /'(I) = 1 is fulfilled. We 
may put f{c>o) = oo. The condition of analyticity, which does not appear in ||3|, guarantees 
that / is smooth and that the behavior of / in one interval, say in [0,1], determines the 
behavior in the entire interval [0, oo]. 

It is easy to check, by appeal to Jensen's inequality, that with S and D given by (0) and 
®, ^ = 5$ and D = D^. 

Often, it is advantageous to work with the dual generator f. This is the function given 

by 

f{x)=xf(-] , 0<x<oo. (7) 



The formulas (jH)-® expressed in terms of the dual generator give the expressions 

ieA ^^^^ 

D{P\\Q) = J2p^f(-) ■ (10) 

ieA ^P'^ 

We realize that a very wide class of potentially interesting entropy measures are of the 
form here considered. In the classical case, leading to the Boltzmann-Gibhs- Shannon entropy, 



we have f{x) = xlnx and f{x) = In^. Further cases work with deformed logarithms. A 
two-parameter version of these, taken from Q], are given by 



if 6 ^ a 

1 I l3-a ^^PT^-, . . 

ln„,^x = { (11) 

x°'\nx ii j3 = a . 

With appropriate choice of parameters (— l<a<0,0</9or the symmetric choice) this 
leads to the family of generators given by 

fccA^) =xhiocA^) with dual /a,/3(x) = In^,/? - . (12) 

X 

With (a,/?) = (1 — (/, 0) for a positive value of the parameter g, we are led to Tsallis q- 
entropy, cf. Tsallis [4J. Listing also the associated complexity and divergence functions we 
find that they are given by the expressions: 



ip\\Q) = Y^j2p^.{i-%-n^ (13) 

s.ip) = A E^' ipr' - 1) = A f E^? - 1) ' (14) 
™^r^S^'('-(t)'>r^(-?-(t)1- 

A significant feature is the factorization property of (fT^ . Note that this structural 
property is not immediately visible just looking at the entropy function |T4|l . 



II. FACTORIZATION 

Let us have a closer look at the factorization property and investigate for which generators 
/ the associated complexity function factorizes. In more detail, with $ of the form (0}, what 
we search for are functions ^ and ( such that 

^P\\Q) = Y,aP^)aq^) (16) 

ieA 

holds generally. We call ^ the escort function. It acts as a kind of mean-value generator 
and invites for escorting, which is the consideration, along with any distribution P = (pj)jg^ 
of the associated escort distribution with point probabilities {^{pi)/Z)i!zA where Z is the 
appropriate constant of normalization. The consideration of escort probabilities occurs in 
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connection with MaxEnt but presents in itself problems regarding the proper physical inter- 
pretation. The literature can be traced from the recent contribution by Ferri, Martinez and 
Plastino, cf. [1] and, for critical comments, from Shalizi P]. The function is the surprise 
factor. This may also be thought of as self-information. We require that ,^(1) = 1 and 
C(l) = and that both functions are analytic in [0, oo[. Thus, we demand that escorting 
does not change a deterministic distribution and that the surprise value associated with 
the occurrence of a deterministic event is 0. The escort function and the surprise function 
need in fact only be given for arguments in [0, 1]. However, the requirement of analyticity 
is a requirement that these functions have natural extensions to functions defined for any 
positive argument. Therefore, we may as well assume that the functions are defined from 
the outset on the whole interval [0, oo[. 

Now assume that $ given by Q factorizes as described above. Then, from the formula 

D{p\\Q) = ^p\\Q) - $(p||p) = Y,ap^) (cfe) - cfe)) 



we realize that 



Pi 



ax) my) - cix))) = xf (y) . (i?) 



.x^ 

In fact, by simple considerations, also using a continuity argument, this is first estab- 
lished for X and y in the unit interval. The general validity then follows by analyticity 
considerations. 

Putting first x = 1, then y = 1 in (jl7p we realize that ^ and ( can be identified in terms 
of /. In fact, 

C = 7ande(x) = ^i^. (18) 
-fix) 

Inserted into (fTTj) we see that 



f{y) - fix)) = xf (^) 



-fix) 

hence 



or 



/(-)(/(^)-/(2/))=/(^)/(|) 



Then 

fix) + Kyl- IM _ } I /(^) -JM 

f{x)f{y) fix) f{x)fiy) 

1 1 

= a , 

a constant (because of the dependence on x only in the last expression and the symmetry 
in X and y of the expression we started out with). In case a = we are soon led to conclude 
that then /(x) = In ^ and we are faced with the classical Boltzmann-Gibbs-Shannon case. 
When a 7^ 0, we use the functional equation 

(l - afixy)) = (l - afix)) (l - af{y)) 

and conclude, as /'(I) = ~1, that 1 — af{x) = x", hence 

~ 1 — 1 

f{x) = = ln_„,o - • 

a X 

As /, hence also /, is required to be convex, we must conclude that a < 1. We realize 
that we are faced with the Tsallis family (with parameter q = 1 — a). 
To sum up, we have proved: 

Theorem 1 A complexity function of the form (0} factorizes if and only if it is related to 
one of the Tsallis entropies, cf. (fT^ - (fT^ . 

III. CONCLUSIONS 

Factorization of the complexity function appears important as it separates the two sides of 
the game, that of nature and that of the physicist. The property can be used to characterize 
the family of entropy measures suggested by Tsalhs. 

Though our results are, hopefully, indicative of central issues for fundamentals of non- 
extensive statistical physics, operational interpretations are not yet in place. The game 
theoretical approach may well be helpful in this connection, see P| for some further results. 
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especially on equilibrium, and for open problems to look into. 
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